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Abstract 

We study the Restricted Isometry Property of a random matrix F with 
independent isotropic log-concave rows. To this end, we introduce a pa- 
rameter Fk^m that controls uniformly the operator norm of sub-matrices 
with k rows and m columns. This parameter is estimated by means of 
new tail estimates of order statistics and deviation inequalities for norms 
of projections of an isotropic log-concave vector. 
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Introduction 

The purpose of this short note is to present some new results concerning 
geometric properties of random matrices with independent log-concave isotropic 
rows obtained recently by the authors. The proofs are deferred to an upcoming 
longer article. 

Let T CR^ and F be an n X A'^ matrix. Consider the problem of recon- 
structing any vector x G T from the data Tx e M", with a fast algorithm. 
Clearly one needs some a priori hypothesis on the subset T and of course, the 
matrix T should be suitably chosen. The common and useful hypothesis is that 
T consists of sparse vectors, that is vectors with short support. In that setting, 
Compressed Sensing provides a way of reconstructing the original signal x from 
its compression Tx with n <C iV by the so-called ^i-minimization method. The 
problem of reconstruction can be reformulated after D. Donoho [6, in a language 
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of high dimensional geometry, namely, in terms of neighborliness of polytopes 
obtained by taking the convex hull of the columns of F. In this spirit, the sens- 
ing matrix is described by its columns. From another point of view, the matrix 
F may be also determined by measurements, e.g. by its rows. 

Let < m < N. Denote by Um the subset of unit vectors in K^, which 
are m-sparse, i.e. have at most m non-zero coordinates. The natural scalar 
product, the Euclidean norm and the unit sphere are denoted by | ( • , • ) |, | • | 
and S^~^. We also denote by the same notation | • | the cardinality of a set. For 
any x — (xi) € R" we let ||a:||oo = max^ \xi\. By C, Ci, c etc. we will denote 
absolute positive constants. 

Let Sm = <5m(F) = sup2,gy^ ||Fa;p — EjFxpl be the Restricted Isometry 
Property (RIP) parameter of order m. This concept was introduced by E. Can- 
des and T. Tao in [5] and its important feature is that if S2m is appropriately 
small then every m-sparse vector x can be reconstructed from its compression 
Fa: by the £i-minimization method. The goal now is to check this property for 
certain models of matrices. 

The articles [T], |2] and |3] considered random matrices with independent 
columns^ and investigated high dimensional geometric properties of the convex 
hull of the columns and the RIP for various models of matrices, including the 
log-concave Ensemble build with independent isotropic log-concave columns. It 
was shown that various properties of random vectors can be efficiently studied 
via operator norms and the parameter F„_m recalled below. In order to control 
this parameter an efficient technique of chaining was developed in [1] and [2]. 

In |9], the authors studied the RIP and more generally the parameter St = 
sup^fzT ||r2;p — EjFxpl for random matrices with independent rows under the 
hypothesis that they are isotropic subgaussian. It is natural to ask whether 
random matrices with independent isotropic log-concave rows also have the RIP. 

Fix integers n, N > 1. Let Yi, . . . ^Yn be independent random vectors in 
and let F be the n x N random matrix with rows Yi. Let T C S^~^ and 
1 < k < n and define the parameter Fj.(T) by 



We also denote Tk.m — Ffc(C/,„). The role of this parameter with respect 
to the RIP is revealed by the following lemma which reduces a concentration 
inequality to a deviation inequality. 

Lemma 1 Let Yi, . . . ,Yn be independent isotropic random vectors in . Let 
T C S^~^ be a finite set. Let < 9 < 1 and B > 1. Then with probability at 
least 1 - |r| exp {-SO'^n/SB'^) one has 




(1) 



1 1 

sup -^(|(y„y)p_E|(r„y)n <0 + -(Ffe(r)2 + EFfe(r)2) 



where k < n is the largest integer satisfying k < {Tk(T)/ B)'^ . 
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In this note we focus on the compressed sensing setting where T is the set of 
sparse vectors. Lemma [1] shows that after a suitable discretisation, checking the 
RIP reduces to estimating Tk^m- The idea of such an approach, when k = n, 
originated from the work of J. Bourgain [3] on the empirical covariance matrix. 
It was developed in [T] and |3] (with T = Um), where the estimate of r„_m played 
a central role for solving the Kannan-Lovasz-Simonovits conjecture; and it was 
studied in [8] where Tk{T) was estimated by means of Talagrand 7-functionals. 

Using Lemma [T] it can be shown (cf., [3] for a similar argument) that if 
< 6* < 1, S > 1, and m < AT satisfies m\og{CN/m) < W'^n/l&B'^ , then with 
probability at least 1 — exp (— 36'^n/16i?^) one has 



i5m(r/V^) = sup 

veUm 



<C6 + -(Tl.^+Erl 



k,m ~ fc,m ) 



1 

-^(|(r„y)p-E|(K„y)| = 
1=1 

(2) 

where A: < n is the largest integer satisfying k < (Tk^m/B)'^ (note that fc is a 
random variable). 

We consider the log-concave Ensemble of n x TV matrices with independent 
isotropic log-concave rows. Recall that a random vector is isotropic log-concave 
if it is centered, its covariance matrix is the identity and its distribution has a 
log-concave density. Our goal is to bound Tk,m for this Ensemble. This leads 
to questions that require a deeper understanding of some geometric parameters 
of log-concave measures, such as tail estimates for order statistics and deviation 
inequalities for norms of projections. 
Main results 

Our main theorem provides upper estimates for Tk.m valid with large prob- 
ability for matrices from the log-concave Ensemble (Theorem [T]) . To achieve 
this we need some intermediate steps also of a major importance. The first one 
is a strengthening of Paouris' theorem ([10]) which originally states that there 
exists C > such that for every isotropic log-concave vector X, {E\X\Py^P < 
C((E|Xp)^/^ + p) for p> 1. We define a natural parameter ux{p) by 

ax{p)^ sup (E|(i,X)|P)i/P. 

It is known that if X is isotropic log-concave then 

ox{p)<V sup (E|(t,X)ni/2^p. 

Theorem 2 For any N -dimensional log-concave vector X and p > 1 we have 
(E|x|P)i/P < C((E|xni/2 + ^^(p)). 

Our proof of this theorem follows in part the original argument of |10j , which 
is then complemented by a new analysis of geometry of log-concave densities. 
We were informed by G. Paouris that he has also obtained this result. Another 
extension is the following bound on deviations of norm of projections of an 
isotropic log-concave vector, uniform over all coordinate projections Pi of a 
fixed rank. 
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Theorem 3 Let m < N and X be an isotropic log-concave vector in M. . Then 
for every t > 1 one has 

P sup \PiX\ > CtV^log (—) < exp ( -t ^ log (—] ) . 

Wcu.^iv} \mJJ y ^log(em) \mJJ 

This theorem is sharp up to ■\/log(em) in the probabihty estimate as the case 
of a vector with independent exponential coordinates shows. Actually our fur- 
ther applications require a stronger result in which the bound for probability is 
improved by involving the parameter ax and its inverse , namely 

Theorem 4 Let ni < N and X be an isotropic log-concave vector in M.^ . Then 
for any t > I, 

Pf sup IfiXl > CtV^lo, f^)) < exp (-a-/ ( 'f;^ ^"^A] , 
\^^cu_«} \mJJ y y ^log(em/mo) / / 

where tuq = rno{X,t) — supj/c < m: k\og{eN/k) < (t^/mlog (eA^/m))} . 

Theorem |4] is based on tail estimates for order statistics of isotropic log- 
concave vectors. By A*(l) > ■•• > X*(N') we denote the non-increasing re- 
arrangement of I A (1)1, ... , |A"(A^)|. Combining Theorem [5] with methods of [7] 
we obtain 

Theorem 5 Let X be an N -dimensional isotropic log-concave vector. Then for 
every t > C\og{eN/l), 

V{X*{t) >t)< exp{^a]^\C-hVe)). 

Introduction of the parameter ax enables us to obtain new inequalities for 
convolutions of log-concave measures. Let Xi, . . . , X„ be independent isotropic 
log-concave random vectors in R^. We will consider weighted sums of the 
vectors Xi of the form Y = J27=i ^i^ii where x = {xi, . . . ,Xn) G M". Bern- 
stein's inequality and ipi estimate for isotropic log-concave random vectors give 
< C'IVpI^^I +pI|2;|1oo) for p > 1. Together with Theorem U this yields the 
following 

Corollary 6 Assume that \x\ < 1 and I > b > max(||a;||oo, l/v^)- Then for 
any t > 1, 

( feN^\ ( ^V^log(l^)\ 

P sup \PiY\ > CtV^log [ — ) < exp - \ \ . 

y jcu.^...«} \ m J j y b^^\og{eWm) J 

We now pass to bounds on deviation of Tk^m- To get a slightly simplified 
formula we assume that N > n. 
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Theorem 7 Let 1 < n < N , and let T be an n x N random matrix with 
independent isotropic log-concave rows. For any integers k < n, m < N and 
any t > 1, we have 

P(rfe,™ > CtX) < cxp(-tA/Vlog(3m)), 
where A = -^/log log(3TO)-ym log(eA^/m) + ^/k\og{en/k). 

The threshold value A in the above theorem is optimal, up to the factor of 
•y/log log(3m). Assuming additionally unconditionality of the distributions of 
the rows, we can remove this factor and get a sharp estimate. 

The proof of the above theorem is composed of two parts, depending on 
the relation between k and the quantity k' = mi{£ > 1: m\og{eN/m) < 
ilog{en/i)}. First, we adjust the chaining argument from |1] to reduce the 
problem to the case k < k' . This step also involves Theorem |3l Next, we use 
Corollary |6] combined with another chaining to complete the argument. 

Theorem [7] together with ^ allows us to prove the RIP result for matrices 
r with independent isotropic log-concave rows. The result is optimal, up to the 
factor log log 3m, as shown in j2]. As for Theorem [71 assuming unconditionality 
of the distributions of the rows, we can remove this factor. 

Theorem 8 Let 0<9<1, l<n<N. Let T be an n x N random matrix 
with independent isotropic log-concave rows. There exists c{9) > such that 
5m{J^ / < 9 with overwhelming probability whenever 

m\o^{2N/n) loglog3TO < c{9)n. 
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